On using generalized Cramér-Rao inequality to REML estimation in linear models

نویسنده

  • Andrzej Michalski
چکیده

The main aim of considerations in the problem of estimation of variance components σ 1 and σ 2 2 by using the ML-method and REML-method in normal mixed linear model N{Y, E(Y ) = Xβ, Cov(Y ) = σ 1V + σ 2In} was concerned in the examination of theirs efficiency. It is particularly important when an explicit form of these estimators is unknown and we search for the solutions of the likelihood equations system by using different iterative procedures e.g.: Newton-Raphson method, Fisher’s method of scoring, EM algorithm, Monte Carlo methods, gradient procedure (see papers: [4], [5], [6], [8]). For the sake of statistical properties of obtained solutions, unusually useful, are the numerical procedures which allow to control the biases and variances of these estimators. Some approximations of these parameters obtained without simulations for MLand REML-estimators of variance components are presented in the paper [2]. Residual maximum likelihood estimation is often preferred to maximum likelihood estimation as a method of estimating covariance parameters in linear models because it takes account of the loss of degrees of freedom in estimating the mean and produces unbiased estimating equations for the variance parameters (cf. papers [2], [7]). Since the REML-estimators are ”almost unbiased” for variance components σ 1 and σ 2 2 we may apply the generalized Cramér-Rao inequality to determine upper bounds of variances of the estimators (see [3] ). This fact can be used to making alternative iterative procedures giving good solutions of the likelihood equations system (cf. [1], [2]). In the paper the numerical calculations for unbalanced random models corresponding to one-way layouts are also given.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A conditional likelihood approach to REML in Generalized Linear Models

Residual maximum likelihood estimation (REML) is often preferred to maximum likelihood estimation as a method of estimating covariance parameters in linear models because it takes account of the loss of degrees of freedom in estimating the mean and produces unbiased estimating equations for the variance parameters. In this note it is shown that REML has an exact conditional likelihood interpret...

متن کامل

Cramér-Rao Bounds for Estimation of Linear System Noise Covariances

The performance of Kalman filter depends directly on the noise covariances, which are usually not known and need to be estimated. Several estimation algorithms have been published in past decades, but the measure of estimation quality is missing. The Cramér-Rao bounds represent limitation of quality of parameter estimation that can be obtained from given data. In this article, The Cramér-Rao bo...

متن کامل

On multidimensional generalized Cramér-Rao inequalities, uncertainty relations and characterizations of generalized q-Gaussian distributions

In the present work, we show how the generalized Cramér-Rao inequality for the estimation of a parameter, presented in a recent paper, can be extended to the mutidimensional case with general norms on Rn, and to a wider context. As a particular case, we obtain a new multidimensional Cramér-Rao inequality which is saturated by generalized q-Gaussian distributions. We also give another related Cr...

متن کامل

Cramér-Rao and moment-entropy inequalities for Renyi entropy and generalized Fisher information

The moment-entropy inequality shows that a continuous random variable with given second moment and maximal Shannon entropy must be Gaussian. Stam’s inequality shows that a continuous random variable with given Fisher information and minimal Shannon entropy must also be Gaussian. The CramérRao inequality is a direct consequence of these two inequalities. In this paper the inequalities above are ...

متن کامل

Adjusted Likelihood Methods for Modelling Dispersion in Generalized Linear Models∗

This paper considers double generalized linear models, which allow the mean and dispersion to be modelled simultaneously in a generalized linear model context. Estimation of the dispersion parameters is based on a χ1 approximation to the unit deviances, and the accuracy of the saddle-point approximation which underlies this is discussed. Approximate REML methods are developed for estimation of ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007